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Abstract 

We show that Poincare recurrence does not mean that the entropy will eventually decrease, contrary to the claim of Zermelo, 
and that the probabilitistic origin in statistical physics must lie in the external noise, and not the preparation of the system. 



As first pointed out by Kroning [ij, and later devel- 
oped by Boltzmann [2j, any deep understanding of the 
second law of thermodynamics in terms of entropy due 
to Clausius Q must involve a probabilistic approach; see 
0, [H for two of the excellent reviews. This was the first 
approach in physics to establish that fundamental laws 
of Nature need not be strictly deterministic. However, as 
many phenomena at the microscopic level such as nuclear 
decay also require a probabilistic approach for their un- 
derstanding, the probabilistic interpretation is not just 
a consequence of a macroscopic system; yet it has to be 
exploited in statistical physics. To appreciate this prob- 
abilistic approach in statistical physics, we note that in 
the Gibbs formulation, the entropy is given by the aver- 
age of the degree of uncertainty Ui{t) = — lnpi(f) of the 
ith microstate: 

S(t)=$>i(*K(*)>0, = 1; (1) 

here pi (t) is the probability for the ith microstate at time 
t, and the sum is over all distinct microstates W. We al- 
low the possibility that some of the probabilities may 
be zero. Thus, one envisions the system to be in differ- 
ent microstates with certain probabilities. To introduce 
the concept of Pi(t), we construct a Gibbs ensemble as 
containing M replicas of the system, A/i of which are in 
microstate i. Then, pi(t) = Mi/M in the limit AT — > oo; 
the limit will always be implicit. If there is only one 
microstate i = possible [6|] so that A/o = A/", the en- 
tropy is identically zero as the system is in i = with 
certainty. According to the second law, the entropy of 
an isolated system cannot decrease. The equilibrium is 
attained when the entropy becomes maximum, which oc- 
curs when all microstates have the same probability: 

Pi (t) - 1/W. (2) 

Once the equilibrium is achieved, the entropy cannot de- 
crease if the system is left undisturbed. 

However, the application of the Poincare recurrence 
theorem Q, see below, gave rise to Zermelo's H para- 
dox, which has not been resolved to everyone's satisfac- 
tion yet, and is the subject matter of this work. The 
recurrence theorem is valid for a classical system and ba- 
sically states that provided an isolated mechanical sys- 
tem, in which the forces do not depend on the velocities 



of the particles, remains in a finite part of the phase 
space during its evolution, then the uniqueness of clas- 
sical trajectories implies that a given initial state must 
come arbitrary close to itself infinitely many times. Zer- 
melo @ argued that since the entropy is determined by 
the phase point, then it must also return to its original 
value according to the recurrence theorem. Thus, if the 
entropy increases during a part of the time, it must de- 
crease during another and this increase and decrease in 
the entropy must occur infinitely many times, thereby 
violating the second law. In addition, it is not just the 
microstate itself, but its probability of occurrence that 
determines the entropy. As we demonstrate here, not ap- 
preciating this fact has given rise to the paradox due to 
Zermelo. We will also show that the origin of this prob- 
abilistic behavior in not in the method of preparation of 
the system, which leaves the system deterministic; rather 
it lies in the stochastic interaction with the environment, 
no matter how weak, for the second law to work. 

According to Boltzmann |9|, recurrences are not in- 
consistent with the statistical viewpoint: they are merely 
statistical fluctuations, which are almost certain to occur. 
Indeed, Boltzmann 0, Smoluchowski [ioj . and others 
recognized that the period of a Poincare cycle is so much 
larger for a macroscopic system to be almost infinitely 
large so that the violation of the second law (decrease in 
entropy of an isolated system) would be almost impos- 
sible to occur in our life. The period of the cycle will 
be many orders of magnitude larger than the present age 
of the universe While an appealing argument, it is 
hard to understand its relevance as the argument com- 
pares presumably a system-intrinsic time, the recurrence 
time, with a system-extrinsic time, the time of observa- 
tion or the age of the universe. Moreover, the recurrence 
theorem is valid for a deterministic system as will be de- 
tailed below, while the second law is valid for a stochastic 
system requiring a probabilistic approach which necessi- 
ates exploiting an ensemble . In particular, Poincare's 
recurrence theorem states that the mechanical system 
will revisit the neighborhood of its initial state with cer- 
tainty (with probability p — 1), while for a statistical 
system, the probability of revisit is extremely small (in- 
deed p ~ 1/W for a macroscopically large system) as we 
discuss below. 
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which is exponentially large of the order of c N , with c > 1 
some constant. We assume, for simplicity, that the time 
required for a microstate to evolve into a different mi- 
crostate is some constant A, and observe the system at 
times t = tj = j A, j = 1,2. • • • , to determine the mi- 
crostates. The dynamics of an isolated system with a 
given Hamiltonian is completely deterministic 



1|: 



an 

initial microstate i evolves in a unique fashion into a mi- 
crostate ij at time t — tj, which we represent by the 
one-to-one mapping i — * ij. Due to the unique evo- 
lution, the system visits each of the W microstates in 
time without repeating until it has visited all of them. 
It will then revisit the initial microstate (it cannot visit 
any other microstate because of the unique evolution) 
and then repeat the entire sequence {ij} exactly in the 
same order over and over. We show in Fig. [T£i the deter- 
ministic evolution of the initial microstate i = through 
microstates Oj at t — tj, shown schematically by j — 
1, 2, ■ • • , W' = W - 1. The next microstate at j = W 
will be [lH, and the entire ordered sequence {Oj} will 
be visited during the next cycle. The recurrence time tn, 
also known as the Poincare cycle, is given by ipt = WA. 
Each microstate will be revisited several times in a time 



t^-tji. This proves the recurrence theorem 15|. 
A more general proof can be found in (l2| . 



FIG. 1: Schematic evolution of an initial microstate as a 
function of time in the phase space. A cell shows a microstate 
and the numbers show the sequential emrgence of microstates 
in time, (a) shows not only the unique deterministic evolu- 
tion, but also one of many possible stochastic evolution. Be- 
ing a deterministic evolution, no microstate recurs except the 
initial one at time £r. (b) shows one of the many possible 
stochastic evolution in which the initial microstate recurs at 
time tk < tR. 



We first discuss the recurrence theorem for complete- 
ness and then its relevance for the second law. 

Theorem 1 Poincare Recurrence A microstate of a 
finite classical system evolving deterministically and con- 
fined to a finite region of the phase space during its evo- 
lution recurs infinitely many times. 

Proof. We consider a classical system consisting of N 
particles, which we take to be point-like for simplicity, 
with energy E in a volume V. We restrict N, E and V to 
be finite to ensure that the system moves in a finite region 
of size |r | in the phase space; see the shaded region in 
Fig. [T] A microstate is commonly defined not by a point 
in the phase space, but by a small volume (shaded cells 
in Fig. Q~|)of the size tq = h 2r ; h is Planck's constant and 
r = 3 A [13[ . The number of distinct microstates W is 

W=\T q \/t q , 



Theorem 2 The entropy in a Poincare cycle remains 
constant so that the second law is never violated. 

Proof. Consider Fig. QJi. Since the system is with cer- 
tainty in only one microstate j(mod W) at instant t = tj, 
its entropy S(tj) = identically for all j. As S(tj) can 
never decrease, the phenomenon of recurrence does not 
violate the second law. 

The same conclusion is also obtained in the ensem- 
ble approach. We prepare each replica in the same mi- 
crostate initially and follow its evolution in time. Be- 
cause the evolution is deterministic, each replica in the 
ensemble will be in the same microstate Oj at t = tj. 
Thus, Pi(tj) — Sij, which again gives S(tj) = 0. Let us 
now consider the system to be initially in a " macrostate" 
consisting of two possible microstates and 1 with prob- 
abilities po and pi = 1— pq, respectively. This can also 
be done for a quantum system. There are A/po replicas 
in the microstate 0, and Np\ in the microstate 1, and the 
initial entropy is S'(O) = — Pohi Po~ Pi m Pi- Since the 
evolution (0 — > Oj, 1 — > lj) at some later time tj is deter- 
ministic, all the Afpo replicas are in microstate Oj , and the 
remaining A/pi in microstate lj, so that Pr(0j) = po, and 
Pr(lj) = pi. Consequently, S(tj) — S(0) so the entropy 
remains constant. It is easy to extend the calculation 
to an initial "macrostate" consisting of any number of 
microstates i, in particular all microstates W, with prob- 
abilities pi with the same conclusion that the entropy 
given by ([T]) remains constant during the Poincare cycle. 
This completes the proof. ■ 
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The above conclusion is consistent with time-reversal 
invariance in a deterministic dynamics. As the evolution 
i — > ij is one-to-one, it can be inverted at any time. Thus, 
the forward evolution i — * i± — > i% — ► • • • — ► ij of an 
initial microstate can be uniquely inverted to give ij —> 
ij-i —> ij—2 — > ' ' ' ~~ * ii ^ h and we recover the initial 
microstate in this reversal. The entropy in this reversal 
remains constant to ensure time-reversal invariance. 

It should be commented that the non-zero initial en- 
tropy for a deterministic system (classical or quantum) 
considered above is due to our mode of preparation. It 
is due to our ignorance about the system and does not 
represent an intrinsic property of the system. The notion 
of probability here is brought into the discussion due to 
the preparation of the system, and we have total control 
to change its probabilistic nature and to change the en- 
tropy so that the latter is not an intrinsic characteristic 
of the system. This entropy of the deterministic system 
can be readily changed to zero by making a precise mea- 
surement to determine which microstate the system is 
in This "collapse" of the "macrostate" means that 
once the system is known to be in a particular microstate 
with certainty after measurement, its entropy will remain 
zero as shown above for ever, even though the system 
is not in equilibrium. This is not how we expect the 
thermodynamic entropy to behave. Moreover, being a 
constant, this entropy will never become the maximum 
possible equilibrium entropy In W, unless it is already at 
the maximum. This gives us the following 

Corollary 3 A deterministic system will never equili- 
brate if it was not in equilibrium initially. 

Ideal gases confined by idealized walls to form isolated 
systems have no mechanism to achieve equilibrium, and 
will remain in non-equilibrium states for ever if they were 
so initially; see footnote 6 in [j]. For the concept of en- 
tropy to be useful requires it to be an intrinsic property of 
the system which should not be affected by the measure- 
ments if we wait long enough after the measurements. 
Thus, the concept of entropy requires a particular kind 
of probabilistic approach in which the evolution must not 
be deterministic; rather, it must be stochastic. Even an 
isolated system is not truly deterministic in Nature. A 
real system must be confined by a real container, which 
cannot be a perfect insulator. Even the container will in- 
troduce environmental noise in the system. Thus, there 
are always stochastic processes going on in a real system, 
which cannot be eliminated, though they can be mini- 
mized. In the case the external noise is too strong, then 
there is no sense in not considering the environment as 
part of the system for its thermodynamic investigation. 
It is the limit in which the external noise is too weak 
that is relevant for a sensible thermodynamical descrip- 
tion of a system, so that the external noise will not alter 
the average properties such as the average energy of the 



system 11] . For quantum systems, this requires consid- 



ering the Landau-von Neumann density matrix, rather 



than eigenstates; see, for example, [121 ] . The derivation 
in [l3 ] clearly shows the uncertainty introduced by the 
presence of the environment. The latter is not part of the 
system, just as in thermodynamics. It is only in this case 
that the entropy will vary as the probabilities of various 
microstates change in time, as we describe below. 

The stochasticity introduces a new time scale A' over 
which the system evolves detcrministically as above. 
Over this time-period, the the mapping i — > ij is one- 
to-one and can be inverted to study time-reversal. The 
entropy remains constant during this period. At the 
end of each time period A', i.e. at time t = t' k = k 
A', k = 1, 2, ■ • • , the current microstate i will undergo a 
stochastic "jump" ( shown by the double arrow i -» j) 
to any of the W microstates j [l6[ brought about by the 
environmental noise. We take these "jumps" to occur in- 
stantaneously just for simplicity. The "jump" may create 
a new microstate not generated so far, or bring it back 
to a previously visited microstate, including the initial 
microstate, generated during its deterministic evolution. 
Such a jump to a previously generated microstate (not 
the initial microstate) would have been forbidden in a 
deterministic evolution alone as noted above. Many such 
stochastic "jumps" are needed to bring the system to 
equilibrium, which requires a time interval t eq , so that 
A' < t cq . The presence of stochastic "jumps" give rise 
to a probabilistic nature to the microstates, their prob- 
ability of occurrence changing with time. This in turn 
changes the entropy with time whenever "jumps" occur. 

How A' relates to the timescale A depends on the 
strength of the noise; here we will assume A' > A, which 
can be reversed without affecting our conclusions. For an 
isolated system, A' — + oo, which is consistent with our 
Corollary that the deterministic evolution cannot bring 
about equilibration (entropy maximization). The exter- 
nal noise causes the entropy to increase with time if the 
initial state was out of equilibrium as shown elsewhere 
11|. Therefore, we now turn to the stochastic evolution 



to make contact with the second law. 

We do not have to consider the actual nature of the 
noise; all that is required is its presence. The actual na- 
ture will only determine the value of A', but not the final 
equilibrium state, which remains oblivious to the actual 
noise. This is what allows the statistical mechanical ap- 
proach to make predictions about the equilibrium state. 
We consider an ensemble of M replicas, each replica be- 
ing identically prepared in the same microstate 0, so that 
Pi(0) — Sio- Consequently, S(0) = 0. This obviously rep- 
resents an extreme non-equilibrium situation. However, 
since the evolution is stochastic, a microstate i makes 
a "jump" to another microstate j (i -» j) or remain 
the same (i -» i) caused by the noise. It is also possi- 
ble to have i — » j -» i, as shown in Fig. [T)d, where we 
show that the system leaves the original microstate but 
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comes back to it at tk- Thus, the recurrence can happen 
at any time t > A', albeit without certainty (probability 
Po(t) < 1) and has no particular significance or relevance 
for the Poincare cycle for a finite system, where recur- 
rence occurs with certainty. This distinction in the prob- 
ability of recurrence is very important, as the entropy is 
determined by the probability. Just because the initial 
microstate has recurred does not necessarily mean that 
the entropy has reversed to its initial value 5(0) = 0, con- 
trary to the claim by Zermelo. One needs to consider its 
probability also. To establish this, we proceed as follows. 

At t'i, there will be JVpi(t[) replicas in the ith mi- 
crostates. In particular, there is a non-zero probability 
Po{t[) < 1 that the system will be back in its original 
microstate 0. However, this in no way means that the 
average degree of uncertainty S(t'i) has reduced to zero, 
as it is obtained by fl}, which requires a sum over all 
microstates that are present in the ensemble. The degree 
of uncertainty of the initial microstate 

uo{t[) = -lnp (O > 0, 

so that S(t[) > po(£'i) u o(i'i) > 0. The entropy has in- 
creased. For t[ < t < t' 2 , each replica evolves determin- 
istically so that the entropy remains constant, as follows 
from Theorem [2] This is true during each of the inter- 
vals t' k < t < t' k+1 , with the entropy changing at t' k as 
the probabilities Pi(t' k ) change. During all this time, the 
system has a non-zero probability po(t) < 1 to be in the 
initial microstate 0. Eventually, the system equilibrates 
when ([2]) holds so that 

Ui(t)^]nW, i = 0,l,---,W, 

which is exactly the entropy S(t) = In W of the system 
obtained by summing over all microstates; see ([I}. We 
observe that in equilibrium, the entropy is exactly the 
degree of uncertainty of any microstate and, in particular, 
the initial state. 

Thus, we come to the following theorem: 

Theorem 4 Even for a stochastic evolution, which is 
needed for a statistical system, the recurrence of the ini- 
tial microstate does not violate the second law. 

The entropy remains constant after equilibrium is 
reached. The recurrence of the initial microstate (but 
with po(t) = 1/W ) in the stochastic case does not mean 
that the entropy reverts to the initial entropy 5(0). On 
the other hand, the true recurrence of the initial mi- 
crostate [po(0) = 1,5(0) = 0] requires po{t) = 1, for 
which all replicas must be in the microstate simulta- 
neously. This can occur in only one way. However, such 
a true recurrence is impossible in stochastic systems. To 
show this, we consider the situation in equilibrium; see 
@ . The number of possible ways the replicas can be ar- 
ranged at time t, consistent with microstate probabilities 



Pi CO, is 

M/Il WPi(t)}\ » e us{t) = W M , 

one of which is the true recurrent state. Hence, the 
probability for the initial microstate to truly recur is 
— y as Af — * oo. The recurrence of occurs 
[H, [13] several times, but with po(t) < 1, so that other 
microstates have to be considered to determine S(t). 

In conclusion, we have shown that the entropy of an 
isolated deterministic system in a Poincare cycle remains 
constant, so there is no violation of the second law. Fur- 
thermore, we have also shown that the second law re- 
quires that the probabilistic nature of microstates must 
be caused by external noise, and not the mode of prepara- 
tion alone. Once the entropy reaches its maximum value, 
it remains constant. It never decreases. Thus, the second 
law is never violated. 
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